Evaluation of English–Slovak Neural and Statistical Machine Translation
نویسندگان
چکیده
This study is focused on the comparison of phrase-based statistical machine translation (SMT) systems and neural (NMT) using automatic metrics for quality evaluation language pair English Slovak. As approach predecessor translation, it was assumed that network would generate results with a better quality. An experiment performed residuals to compare scores accuracy (BLEU_n) those translation. The showed assumption regardless system used confirmed. There were statistically significant differences between SMT NMT in favor based all BLEU_n scores. achieved journalistic texts from into Slovak, if trained general texts, such as Google Translate, or specific ones, European Commission’s (EC’s) tool, which specific-domain.
منابع مشابه
Neural Machine Translation Advised by Statistical Machine Translation
Neural Machine Translation (NMT) is a new approach to machine translation that has made great progress in recent years. However, recent studies show that NMT generally produces fluent but inadequate translations (Tu et al. 2016; He et al. 2016). This is in contrast to conventional Statistical Machine Translation (SMT), which usually yields adequate but non-fluent translations. It is natural, th...
متن کاملPairwise Neural Machine Translation Evaluation
We present a novel framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework, lexical, syntactic and semantic information from the reference and the two hypotheses is compacted into relatively small distributed vector representations, a...
متن کاملAdditive Neural Networks for Statistical Machine Translation
Most statistical machine translation (SMT) systems are modeled using a loglinear framework. Although the log-linear model achieves success in SMT, it still suffers from some limitations: (1) the features are required to be linear with respect to the model itself; (2) features cannot be further interpreted to reach their potential. A neural network is a reasonable method to address these pitfall...
متن کاملStatistical Significance Tests for Machine Translation Evaluation
If two translation systems differ differ in performance on a test set, can we trust that this indicates a difference in true system quality? To answer this question, we describe bootstrap resampling methods to compute statistical significance of test results, and validate them on the concrete example of the BLEU score. Even for small test sizes of only 300 sentences, our methods may give us ass...
متن کاملMachine translation evaluation with neural networks
We present a framework for machine translation evaluation using neural networks in a pairwise setting, where the goal is to select the better translation from a pair of hypotheses, given the reference translation. In this framework, lexical, syntactic and semantic information from the reference and the two hypotheses is embedded into compact distributed vector representations, and fed into a mu...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied sciences
سال: 2021
ISSN: ['2076-3417']
DOI: https://doi.org/10.3390/app11072948